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I. INTRODUCTION 


Let there be given c independent random samples of continuous random 
variables of size n,, n.,, ... ,n_, where n, +n, +... + n.=N3; and denote 
2 h c 1 2 Cc 
the observations in the 1° sample by Xiqo Xzge cee > XL Suppose it 1s 
desired to test the null hypothesis that the samples all Come from the same 


population. 


Birnbaum and Hall? proposed for this null hypothesis the following 


two-sided and one-sided test statistics, respectively: 


D(n,.n,, gyre pil) 


* * 
, Sup |F, (x) = F; 0) ; 


X,1,) 


D’(n,.n5, ee see) Sup [F, (x) ~ F;(x)] ; 


X,1<j 


* 
i,j = 1,2, ... j;c, where F. denotes the empirical cdf for the ‘at sample. 


Il. COMPUTATIONAL METHODS 


Under the null hypothesis, the c samples may be considered as c successive 
drawings of Ny oNy, e+ oN, observations from the same population, with equal 
probability of each of the N! ways of drawing the ordered sample of size N. 

The values taken on by the random vector [F (x) F(x), a FOO], for 

fixed x, after a component-wise transformation k. zs n.F, (x), establish a 
one-to-one correspondence between the combined ordered samples and a path in 
c-space from (0,0, ... ,0) to (n,.n,, Pre on). The number of distinct combined 
ordered samples (paths) is N!/(n,!n Lene: n!); each of which is equally likely 


2 
to occur under the null hypothesis. 


t Birnbaum, Z.W. and Hall, R.A., "Small Sample Distributions for Multi-Sample 
Statistics of the Smirnov Type,'' The Annals of Mathematical Statistics, 
Vol. 31, No. 3, pp. 710-720, September 1960. 


Introducing the notation 
Q(k, .k,, a wat rk) = number of paths from (0,0, ... ,0) to (k,,k,, Rae eK) 
the following difference equation is established: 


Qk, k,, ee ki) = Q(k,-1,k,, saers rk) + Q(k,.k,-1, sas rk) 2 er 


+ Q{k, .k,; oe »k-1) 
with initial condition Q(0,0, ... ,0) = 1. 
; mo < < i= 
For a given subset RC R {(k,>k,, salted sk) [0 k, n,, i Ie ee, er, 
let Q(k, »k,, irs sk SR) = number of paths from (0,0, ... ,0) to (k, ,k,, ot. Ke) 


not containing points of R. 


And, as before 


Q(k, >k,, oe »k 5R) = Q(k,-1,k,, ers »k 5 R) + Q(k,.k,-1, ee »k 5R) aD ation 


+ Q(k, »k,, ve rk -15R) 
with conditions 


O(0. 05 ss. 50) = ks 
Q(k,.k,; re rk 3R) = 0, for (k,>k., ee ok) eR. 


Under the null hypothesis, the probability that the samples determine a 
path from (0,0, ... ,0) to (n,.n,, sad n) which does not encounter any 


point of R is 
Pe = Q(n, no, oe Nn 3R)/[NI/(n, Ino! oie n!)]. 


If our decision rule is to reject the null hypothesis whenever the samples 


determine a path containing points in a given set R, then 1 - Pe is the proba- 


bility of an error of the first kind. 


The regions of rejection for the two-sided and one-sided tests, are, 


respectively, 


+ 
D(n,.n,, — on) > r and D (n, >No, ne N.) > Y, 


; : ; + 
which determine the corresponding sets R, R 


R = {(k,,k,, ee so Sup | nik; - nik, | > n.n.r}, 


ae ? 
=r . 
R = {(k,.k,, eens k is oe o BE > nn zh, 


Where 1,)°= 1,2. i«< 3c. 


The tables were computed by evaluating the difference equation for 
Q(k, »k,, bark kK 3R). 


For sample sizes not included in the tables, the inequality 


* ® 
PID(s.,N., on.) Sr] = P[ Sup | F.(x) - F. (x) |< r] 
1 ae c ae i: j 
X,1,) 
* * 
=] - P[Sup|F, (x) ~ F(x) | > r for some i < j] 
x 
= - ar | oe ee 
1-<£f > P(D(n, 1,» ny) ot leak a Ce 


iSjS. .<k 


allows the tabled values for both equal and unequal samples to be used to 
test the null hypothesis. The test will be conservative, but should prove 


useful for the range of values of c for which it would likely be applied. 


Asymptotic expressions are not available for extension of these tables. 
Dues ; m 
As a matter of fact, Hodges” points out that asymptotic expressions 
advanced for the case c = 2 are inaccurate to an extent that their usefulness 


is questionable. 


ITf. EXACT TABLES 


In their paper, + Birnbaum and Hall published the probabilities 
P[D(n,n,n) Sr] for n = 1(1)20(2)40 and r = k/n, k = 1,2, ... ,n, such that 


the probabilities for each n range from less than .90 to more than .995 


“Hodges, J.L., Jx., "The Significance Probability of the Smirnov Two-Sample 
Test," Arkiv fur Matematik, Vol. 3, 1957, pp. 469-486. 


The tables appearing here are an extension of the Birnbaum-Hall tables. 
Table 1 contains the probabilities P[D(n, ... ,n) © r) with the number of 
independent samples of size n ranging from three to seven and the correspond- 
ing sample sizes taking on values from sixty for the three-sample case to 
five for the seven-sample case. Birnbaum and Hall's values are a subset of 


Table 1 of this paper as indicated in Figure l. 


Perhaps of more importance, Table 2 contains the quantiles that allow 
the test to be applied to samples of unequal size, an option presently not 
17Mg°Ms < 25 and 
< 15 are tables P[D(n,, ae nj < Teror- rt S0.416 Oe, 


available. Here for the useful cases c= 3, 28n 


= < 
Cad, Z Nj N,N,N, 


1.0 as represented in Figure Z. 


Figure 1 Figure 2 


Throughout the construction of the tables, the variables were computed 
with fourteen decimal-place accuracy. The probabilities were truncated after 
the sixth decimal place to preserve agreement with existing tables. The compu- 


tation was carried out on the CDC CYBER 76 computer. 


The inequality constraint on P([D(m,.n,, ees nm) < r], appearing in 
Section II, may be useful for establishing a lower bound on quantiles that 
were not tabled. However, the software that produced the table is available, 
making it preferable to rerun the computer program to obtain exact quantile 


values for any specific set of sample sizes. 


IV. EXAMPLE 


For purpose of illustration, consider four independent random samples, 


of sizes five, seven, seven, and thirteen, respectively. 


Sample J] =0.927, -2.243, 0.815,.-0.344,. -0.250 

sample II -0.451, -1.516, -1.447, 0.504, 1.645, 0.022, 1.098 

Sample III 0.032, -1.772, 1.049, -0.073, -2.053, -1.123, 0.799 

Sample IV 0.250, -0.185, -0.028, 0.004, -0.462, -0.032, 0.279, -1.053 


Os507, 0.235,.0.510, 1.103; 0.241 


The null hypothesis to be tested is that all four samples come from the same 
distribution. Evaluation of the statistic D(5,7,7,13), ordinarily programmed 


for machine calculation, can be carried out in the following manner: 


1) Pool and order the samples 
-2.243, -2.053, -1.772, -1.516, -1.447, -1.123, -1.053, -0.927 
~0.462, -0.451, -0.341, -0.250, -0.185, -0.073, -0.032, -0.028 
= O20049, 02022, 02052, 02255, 0.241, 0.250, (02279, 0.504 
0.510, 0.597, 0.799, 0.815, 1.049, 1.088, 1.103, 1.645 


* 
2) For every x in the pooled sample, evaluate Fe (x), i= 1,2,3,4, and 


* * 
calculate Sup JF (x) “ F, Gd], i,j = 1,2,3,4 


—H— = meBeewre © 0O 0 OC 8G 86Gb Oo Oo Oo Ob & ©& 


Py (x) 


Wes 
1/5 
1/5 
L/5 
1/5 
1/5 
1/5 
2/5 
2/5 
2/5 
3/5 
4/5 
4/5 
4/5 
4/5 
4/5 
4/5 
4/5 
4/5 
4/5 
4/5 
4/5 
4/5 
4/5 
4/5 
4/5 
4/5 
5/5 
5/5 
5/5 
5/5 
5/5 


F, (x) 
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F(x) 


Xx) 


Sup 


Dm ooaoeooo0oaodooooooeocr.ooogeo0oeoqgeqgctodcoeoeeoseoqoeo°oo oc. cl cc. co 8 928 C8 8 OP 


3) Choose the largest number appearing in the final column; that is, 
D(5,7,7,;13) = 0.08: 


The critical level a is defined as the smallest significance level at which 
the null hypothesis would be rejected for the given observations. Table 2 
shows that if the four samples were from the same population, 

P[0(5,7,7,15) = .6)] = 0.701271 ands PID(S,7,7,15) = .7). = 02827140. 

Therefore, P[D(5,7,7,13) > .6] = 0.298729 and P[D(5,7,7,13) > .7] = 0.172860. 
Since, in this example, D(5,7,7,13) = 0.65, : would be between 0.18 and 0.30. 


V. APPLICATION 


The test found application in a bomblet study conducted at the Ballistic 
Research Laboratory. In this study, bomblets were supplied by three different 
vendors. Fifteen bomblets from one vendor were filled with a high explosive; 
thirty bomblets supplied by each of the other two vendors contained an inert 
substance. All bomblets were subjected to the same field test, meant to sim- 
ulate the dispensing of a bomblet by a type of munition; this resulted in 
an out-of-round characteristic. A measurement was then taken in order to 
determine the degree of ovalness. The experimenter wanted to establish 
whether bomblets from all three vendors, filled with two different materials, 


achieved approximately the same degree of ovalness. 


This is tantamount to determining whether three independent samples come 
from the same population. Thus, we were able to state a hypothesis, evaluate 
the two-sided test statistic, compare it with the tabled values, and determine 


whether or not to reject the hypothesis. The data and analysis follow. 


Hj: All three samples of bomblets achieve the same degree of ovalness. 


H,: At least one sample of bomblets achieves a significantly different 


degree of ovalness. 


ig] 


The data (measurement of ovalness) are as follows: 


Vendor I 0.002 0,010 0.036 0.004 0.006 
0.038 0.023 0.003 0.013 0.002 
0.013 0.010 0.013 0.008 0.007 
Vendor II 0.007 0.004 0.003 0.010 0.009 
0.005 0.011 02002 0.011 0.007 
0.010 0.011 0.023 0.009 0.029 
0.024 0.004 0.020 0201.1 0.019 
0.004 0.014 0.011 0.008 0.009 
0.014 0.011 0.016 0.007 0.013 
Vendor III 0.007 0.001 0.072 0.013 0.001 
0.025 0.007 0.010 0.028 0.004 
0.002 0.014 0.020 0.041 0.018 
0.011 0.010 0.007 0.035 0.001 
02015 0.008 0.008 0.007 0.007 
0.047 0.015 0.054 OF 010 0-020 


The test statistic takes on the value D(15,30,30) = 0.2333. Quantiles of 
D(15,30,30) are not tabulated, and so the computer program which generated 
the table was rerun to obtain exact values. The results showed that 
P[D(15, 30, 30) < .2] = 0.148915 and P[D(15, 530, 30) S .3] = 0.650568. 
Therefore, the critical level : would be between 0.35 and 0.86. 


‘ 


The data do not suggest rejecting the null hypothesis at a moderate 
significance level. Therefore, the experimenter concluded that the 


three bomblet samples achieved approximately the same degree of ovalness. 
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